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Btf^0B1fc*ftft-*-3ftft¥JSi:& . 

<fc 9 »feftfcBfcflW*AilL«~|BaH-a 

B£*^#©i, 

2 E«oSRI^'f yr v^gg. 

[it** 3 ] imM¥»tmimimmt£? w t*# * 

tt 5 £ t fc 1" 6 »** 1 * tt 2 lE©tf>igli jK-T 
ftfc r. t «r<KMft t i- s W#Jf 2 R^oitBltf'f yf^y 

[»**e] «re«*#«i!tt, «nEBiii±-c»**nfc 
«HBa««>^ rami* *mm- 

£ff 5 r t *: W* i: 1"* »#* 6 W w 

[MM 8] i»B»*¥«ri, *-A;>j$ftfc*t&<&© 

[t»*«9] (Wiafll*#«tt, *WSBiB±-C?«**«)- 



e W«H» « £ 5 r ,!: £ 1" S 3 £ fc I* 
4 e«t©XHI#'r * y^gt. 
[|ft*4 1 3 ] l iE^tf>i§|iB#f vr * ^^iS« 

£fflv\ Stria Aifc££<Pife&tf^ ttHEBifc^T^y 

A. 

1 4 ] n*« i iB«©^PS^f yf ^ >rmm 

[0 00 1] 

[0002] 

[0 0 0 3] u&»u r©J:5 4»li-Ctt«*rt«!:flMR 
[0004] -t(0*-cgft<^lcAofcJ;5^S 

[0005] *\ ^?y h v^^A^*sv>-ctt, 
WM¥3-i 2 9 7**fcBS*3iiTV*aJ:5fc:, ^7 

LTV ^Z>i%<$9. t omx- Y 7 >*s-'V£ if t?»i!&Sr 
oTf^**Ji»5i:V^ofc»&-**>S. r ©($(£, 
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«*©-tt*iMr$:fBJfc1-$»£\ TJMt 
3§©£»t::M LTlfc- LT*J < * 9 »Br^*i«i|©i»tJ«* 
fcov^r*»"C*J< ft if UittftfiT, XJB©ttatfBI;h> 

[0 0 0 6] Sfefc, tAftflUSlEttett©*:©©^ 
[0 0 0 7] 

[JMJ-WHifeLJ: 5 t-rs^M] r. ©i 5 t^&T-fit, 
3aiB»IB-efl!f«*»SH-5fc»lc, «Hft*Wj«rfc£©# 

S^ffl^TPfl^6<J^Lfc[3it^5rLTV^c9 LTV 
fc 0 L^L, rft£>©#Srefiti?5 LTfclf L^*ftV> 

ct o Ktnm^itc 9 , *M\cmm#&mtt:it*>K. t o 

[0 0 0 8] **WT»tt!6>d»4ra«S:»»i-5fc«>K, 

1f«©^9»9 4rfToTV^^aicio^T, ittlfctr 
LTV5*» b v 5 1f*£ J: 9 iSgS|$lc£;L3 r. k 

[0 0 0 9] 

[^£fl?*-r3fc&©#a] ^jswfcisaiH*^ ^ 

7V>^»fit, AJ4^^P>B^fcfe5*f*i^Sr*g^ 

«*A«uR'>«jaii-5H«iteai*ai:, Babbles 

$ itfcSfc* Ait^TPMi fc* 5 BttX^S 
[O0lO]^U<li > 1MrE£{b;ra#ai**ttMfelc 

[0011] swBJMii#aM:aiHafcffpr«*7 i nf*y 

[0 0 12] *fc, ^fSMlCiST'o-fe^gffi^xA 
fit. i©i§H#^V7V «WBAttj6«r 

f*»fm. mmBm^yy^ h(ommt Lfct>©-e 

[0 0 13] $ e>ld, *»WlCiSJ8ll#f«^7 l A 

fit, wisaRi^^T 1 ^ Vi/gesr2»fflv\ »si£& 



[0 0 14] 

[ftUBl £*T, **W©ft*Wft*ia©f^ffl«r»Wi- 

5. 

[0 0 15] B*Afctt»*LJ:5 b-fZKmntm®. 
#£L, fHf*>7^©M¥Siat) BJft£©Bifc 
#®flMEi£#©fc: <fc 9 AJfi£TS^#a©iBffi-Li;:&* 
Ai&&Kv5##, BaufiilJ:fc5#**SriB^ 
»**afc±01iffi±^*MMfefc» 

r©»*flrafcs<J^T, M*tiHR£j£¥a£ 
±0, tr-A«*«©aEftsBfi¥a*:«»r5fc»©«i 

*Wf«as^J***t, MW&*Ci£#aic±9B*jSi'>-lE 
££*l6o »**ixfc»«»«r«fl[l©«f'C?fcffi 
fl^-arSi 5 fix i^t*^^ 7©^ft^s|p§jx5o 

V% tyoWUfflZftZo 

[0016] Z.nmmcX.V). A**|c^S#iWt*L 
fc*rtfe*lc*^-A©^#y h^StJ, A*£fc^3# 
^fa £Jg * LT v 5 © B tt^C ir v ^ 5 BPMI- d>o 

[0 0 17] 

Wf , yTV-^/V, 1 3 7, 1 4 fit 

yjtPi^Ks, 1 5 izmmm&m* ? v 

-Va^ 1 8fit:/7:/h^R, 19»S«#, 2 0(4 

ft^fM, 2 1 fit h 7 2 2 fit*fed?^ yf^y 

[0 0 18] Hm*^7aKiS^^Bl4H, -r-r^a 

1 7^b©^lcj$:CT. xfy^V^- ^Sr^oT 

A^t^acSrW^, *h*iS«tW»B*y h!7-* 1 5 
^LT7-^f->3yi 7(rfejP>-B:5tiiESr}* 
o„ 3MHMKffl*s' h!7-^ 1 5 fit, ES^^^iiHtft 
ffigiWl 4fOY^f 3>-t!7— ^^x— ^aV'Sr^I 
/O^T?*>5. eMftilHtffl^y h^-^ 1 6tt, ^ 
y 1 ai^roeMfe^ae^SrfflVTy-^^x- 
->3V1 7*-CSA/TV^5 0 

[oo 19] 4-, ^4mftg.xy°7>hZ&Uvx^z 
£Stl 911. 7°7>- b(DmM\c\,^^m2 OlcML 

xyy^hmmi s*itu**5 ti,x\,^Wr&*%z. 

5. £Stl9li, h 5 2 1 5rffiV>T, I'd© 
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mUl 8 ©&«£*§ L^-fo 
[0 0 2 0] ^yf^Hli, ^m#i9* s iiS± 
T*JgU^Ufcfi!:@ (x, y) £$*PU *tl,£!7-** 
■r— >a VI 7{Cii^J-r5 0 fcfc*U (x, y) (ijttt 
*fao£9®ffi©t<fr£lI,&i Lfci:t©x, yitt£ffi 

[0 0 2 1] V~9 7.7—\ VI 7f±SRiftlKffl^3' 
by — * 1 5 ^Lt^SA^ 7 1 3©lS©X-i$ 

strati 9ii)tL^LfcII±rotti {x, y) 

*>e>fta* ^713 *»!s»r A**r£tT© ± 5 i-tw-r 

Rx = atan(x/ZT), Ry = 

[0 0 2 3] £«>*i©tnrfc*<s#, 35 (Rx, R 
y) #£»t£»**5 1 3OT^gSr^lE-r5o 1-*fc> 
*>, x*|6]|r-Rxg, Y#flfc-Ry 

amuRS* 1 4 i4g&#* ? 1 3 &m>to zti\cx 

[0 0 2 4] — i£8i;**7 1 3le:f4*£,#>f 

■ 2 2©*#ilifc3J:5fc*o"CV*S. 
[0025] rcfc^ £M^L/TLfc7'7yhg 

? 1 3!iMft*, ^*3d^o#fe7KW>'7 l ^>^7'f' MSB 
2 2©3tas*©*#Kafc6±5K:*5. *©*:«>, 31 
#fcV*5fiW?Jl2 0«i£m*l 9*s^9Vh3SBl 8* 

[0 0 2 6] &*5, w V^Ktl 2 2 Srttg? 

5i«tliT*t ft^^g-a* & 5 „ ^©J$tai^-7$7- 

[0 0 2 7] 13H:, 513 Jc#&#>r >tV 

©HsfltcW:^— ©#M##*W-LTS>5. r©H^"C 
Ht. *W^7^^7^ h^«2 2J3j:VwiiSr*| 

[00 28] *H»^-efc, •Mrfftft^-cr? > h Sr£ 
2 0 izMVX^fy > hmm 1 8 £Jt L^* 5 i: LTV>5 



5o 

[0 0 2 2] 0 214. S&tV^tV'T 1 l©HffiiH 
8Sl£jLT^57U-Ai©§|^£^Lfct>©T-;Sb3„ X 
— A^Z= l©i#tC®ffi_h©;k (x, y) <D%Mb<a 
1*^Srxtt*lRj, ytt^ftl-StLT (Rx, Ry) t 

Rx = atan(x/T), Ry = atan(y/T) 

Tr±iBffia»&<R«ft*ffi*Aoj£©E 

^{k-f5tBffi±-r (x. y) ©^«^ax.5t©T- 
t^BX-A^Z= 1 ©B$©(x/Z, y/Z)©fe*(CfeS 
X-A^£#£fci §©#!&&£ ©-f*U4, 
atan(y/ZT) (* 1 ) 

[0 0 2 9] gfif 1911, h7>*s—'<2 1 SriB^T 
8©^«§rSt*-r„ 

[00 30] * y fv**/W 1 2 f4, glS# 1 9 #Wffi± 
"CftUSLfcttll (x, y) «r«*lU *ft£!7-*;<. 
7-> 3 yi7i;&ftit5. fcfc'L, (x, y) iifttt 
2f|p)-o£ 19 nB©*<L»*J9(;& t tfc t * ©gEWC* 5 e 
[0031] y-^^x-^a yi 7(4jgRSS^ffi^s' 
yy—? 1 5Sr3>Lxgia*^7 1 3©5I3e©x-a^ 

SftfcKWffl 9;SS»Ljj<LfcHffi±©tt* (x, y) 

a»e>#fe#-r yf^ ^^«a2 2*»*»f«**r±EjR 

l*:fliv*TfrtM-*. 

[00 3 2] Ea* * 7itR5g«B 1 4 L 

T9L£©££ (Bx, By) SrHv^fetf*. rtvSrffl 
I^T, «S (Rx-Bx, Ry-By) ^fe'tt^fitf^ 

y7^y^7^ H2 2»t. -f xzmc- 

Rx + BxS, Y*|RH:-Ry+BySfcWtJ:5 
r-f v^«IS^i^e2 3lc^§ 0 jK-fvy-f v^9-f 
hgt2 2»t. *©fe«, 7°5vh^®l 
1 gtfffiUFL-C^ST^vhSSBl 8z>s^(*:W»-a» 

[0033] $ e>i-. na*^7 1 3 t#fe#-r>-x^ 

^7°^ 1 1 -Qife£ti1zm$:'¥fc\ztiz>Z 0 ic**?* 

fct>©!C5-f F*ST5±5fcU Sa7J^7SHa^ 
if 1 4©©JI5BIC < t»9[6lJtt>ix^:v^{$:A5SSMl 91- 
<fco Tit ^fettle 14, M^>7^yrgi22 

[0034] H]4f4. tynVffiifp^WLh LT» 7^ K-CI4 
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5Kbfc0»J£jjH% 4 0 Htzfyyvmrni 8\Ctt\jh 

[0 0 3 5] !7-^^—>3yi i£SiiBffitf>j& 
&© ^©flSH fc t* 5 ^ 5 tSMUmm £ Ht ^ 5 *» t ^ 5 
T-^?r^oT^5. H5te;i©T-:7Vw©0t|-e& 
5. £©?'-?>©* l f$2£ltfflUB©£© 
*HB±©«*, ^3mim^(0^ »4?iJ;6S&$§© 
•*K*o-cv^5. r © J: 5 fcy-yA'fcttaH*©*™ 
*©BB±fcd5*«i©g©«*©'5 !f -* 
bthlz'SmZixT^Z, ft. igJB©**©^-*^ 
±©Mjft£#T©lIj&©fWa»e>1IM&S*i"C^<&. 

[0 0 3 6] r.©^-^Sr±*»e>NI#tcttSRL.Tv> 
#> ?yf^A'12i>&OH (x, y) #SB2?lJ© 

[0 0 3 7] 5 l -://ufc£tt**U'0< LTfc, &SS© 

[0 0 3 8] ttlS (x, y) as£*ftfc#&fctt» 
JB4 JJ©«*©#*a»fe*©«HBR:o^T^$ 5 ^^4 

7!i»bt©^^yf-*A*i/«J:5»*SrW*1-S. fcb 

[0 0 3 9] ^-^^f-i/aVl T-C^yfOA!) 
/§J9«rfr5fc«>fctt\ RS 2 32 c/f^-^X7 1 - 
-> 3 XOHJAI*- HKW = 
5. F-^-r-v/a yftij^ib fNo. 1 ONJ , 

TNo. 2 OFFj * ifrofH^iaW K£j£9, ■£ 

[0040] roi5*»fP*r1T5ii:»!:±o-C % 
£5 lefts. 

[0 0 4 1] ^*-C(41-^T^ yfvM^uwflHg 

*r-t©**ffiv^T, JSbSS*ifc«»«:«*lEb-C^fc 

5LTfc«H»«)|B]©B3"J*«o»tfc<v\ roi^tt, B 

m&m&m^x tot ^mt-ms&^^^-r-sft&os^jte^ij 
&\tmi tract**. 

[0042] 5-zv<owtmm\z.. gmmi9asgm7 f 

©IiE±©ffi^ (x, y) t^V — ^^y—^B S\ 7 lC 
[004 3] flWKttB 6 lo^-f i 5 WEtiUMMlO* 



7tt%*y ©Mto1ta*> e> r. © * ^0 A£©*B{fe& 

0 ttl-f t ^ o fc 7 /w* £0 < 5 r t (C i o TH^T't 
5. Bfcrtfc**©*^#fcfttf**©*^*9J0ffl 

[0 0 4 4] »9WS;h,fc**©*^©B*©B«© 

(x, y) fcifiv^t>©«r»9aii-. 2o£JLb©WfcW* 

Si-5#g-tcj4, BB±-e-*fe±fcjfi^t>©*r».e. 
[0045] mi*titcmmz>'piz&frtLX^6imc>& 

[0 0 4 6] !7-^7-i/3yi 7tCte, &$©#-*§• 
bZtiicttfc-fZifr&tfjy'rjyyyj h£@2 2© 
a*fcafcbfc^-:7A^«iW<SivC^5. E7lcr© 
r-^©^J«r^-fo r©r-^©f5l?iJ^aS©# 
«2^«M««©««:. %3mm&m>Tj>? 

*«r*f. »«Sftfc«»©#**:::©5 l -^A'©*i 
WiilfcJfclfcbT^* » -SbfcStett*.* yf^ 

^eafiss^e 1 4 km \.x&mtmm* 
i5fe^uta*^?i 3 ©»<"*#***:»*•* 

8. ^#*9itHiM^«14tt£©*fc«^fttt* 

^713 *©&*, 7 1 3 

1 9^tfcfi*(i«:'{>jfii'^^©5*^ 5 li5©SA/* 

[0 04 7] m#flcifr-&#-< i/y- 4 h^B 2 2 

©7-f h*^^«rfl86i-r {S^*2 0«Sm 

[0 0 4 8] $b{cH8tt£m*l 9d5^S4r}ft^-r 

l^T, 8 0 11^!)?, 8 0 2 {±51^^-3., 8 0 314 
■vtxtfjyf, 8 0 4Ji^-Jj<-K-C$>5o ^©^ 
§§©«fi&ttEll bmcx-hZ, ^ = a|i7^y 

[0 0 4 9] £m#»4^!>^8 0 l^tft^-frtlCto 

1 1 ±l^»4KS*f«i:/S5t^©*t(l!45S^^-^ 8 0 
2©Jg"C*^$ixTV5. jK^y^8 0 3SrS^^-^ 
8 0 2©*©fgUfcL;fc^&S§©JSg£:SU J > -^!7^3 
0 l©#*y£# = a©* B 
[0 0 5 0] ?-^f->ayi 7^(C<4, *=-=l<D 

S2 2©^SSrffilCbfcx-^>'^5t&«fi$*tTV>.5. 12 
9tcr©T— ^/w©0!ISr^1-o r-y/w©^ l?0f4y = 
a*B#*, B2?iJ»4«ESi&> *35!lf4#fe^Vr^ 
hgt©x*[S|<D^I, B4?iJtt(^b< y*(6] 
©£&£^1-„ 
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[00 5 1] m&.£thtz*=-^-<Dl%n%f%$;Z.<D7--7 

^sbsrhuksb i 4K*t[*xammm*y w 

*^7l3 Srlb*>1-. ■£©££. ^713 teESi 

#1 9#»USLfcv*«^lMM*ffiG©*M/+K:<3 

[0 0 5 2] jfc&tf-fl'TW^-f h§£B2 

[0 0 5 3] PJtiic. *g^-f £4&ft©&£fcBB±©ffi 

[0 0 5 4] IfflS^-, ES#»i. »Ljj*LfcV**«© 
*#Sr*-#-K8 0 4i*)A*-*-*. > 

[0 0 5 5] ^SftfcWS©***;:©^-^©* 

/ ymmmtmmnz ©ii©* 5 ? 

B©*MMz<3J:5***li:fc.5. v 
TOfyJ h£B2 2 ©7^ h*«»«rfia&i-itfc 
ft^Jt2 0Hi4r©»»^»U**^fcA»31*-e* 

[0 0 5 6] S&terciSfcfiS**? 13 

^yf^m h£B2 2*qfcfti!>o?t>ffltt&ttre 

tfWefcS. 01 0lc->^rA«^Sr^1- o 
vy-jWyj 2a*E»#*9 l sfcBJESft 

[00 5 7] SffiM 1 9 I*. {fc^M 2 0 fc#ffiff*fc U 
TVS. »^M2 0ttfl^fcff5»Brfca#Lfci*K:, 
h7V->-/^ffl^t£Ml 9 tc^£<D#g 
5. 

[00 58] ^©S&SrgttfcgffiM 1 9 tt, ^©tgj^T 
lil*>3BS*p<?l 3©WB&Mffifc!fe1M:3K:i7-* 
^-v'a V 1 7 ^jf^-TSo 

[0 0 5 9] V — ?7*y-— is a VI 7 #0*^2 0 ©Jg 

-f l 1 Bl«rfc, iSHHUSffi^y h?-* 1 

5 fc#LTS£8J 7 1 3fcttl* fchfc 

%.u*/y&mmmmm 1 4 t©¥a©«««r«^-r 

#*7iilHMUEa£Bl 4©rt, lotLMfiw^di 



[0 0 6 0] glfli. hy^is— ^SrffiVT rr.©7* 
7>HSfi«:jMJHi:J:J G^?*2 OK^-f 5. R 

[006 1] * y ^<*/H4. 1 9 #Bffi±-CJB 

L^Ufcteg (x, y) SrlSfcU ^-ftSr?-* 

[0062] 7— ^^x— >a vi 7 tiiUHsaBya* y 

h 17—^ 1 5Sr^LTSftS*i$ix-CI/'»5e«*^ 7 1 
3 ©m&©X-A^Z SrP«av^fc>-ti-5„ '^r LT. * 
^■fc^i 0 to <b l 9 ri 5 *t LfcSffi±© 

4fcB (x, y) 4»6S&afc*iVC:^3£«;&;rt? 1 3 
ft»*»1-AJt«rWli-5. (Si) r©*l©IH*fcS 
<J£, ft* (Rx, Ry) $M£tf»fta&4ftTV*5£ 
ffi7J^7 1 3 ©^aSraM-r-5, x^ftK-Rxg. Y 

*rtifc-R y«fc'»t»^-t«t 5 tjfrfrfcaiiJMwa*? 
hhmksb 1 4 ic&s. affiKR**i"cv^Kft*^5 

BMIMKSBl 4tt£©B©J:3fc3lffi«RS*i/C^* 

7 1 3ttg&#l StfjBXfcffiBtfBffi©**/*^ 5 

[0 0 6 3] gm*^7l Slzttfa&tfjyy-jyyy 
<4 h$B2 2*s«i{+tfC*)0, *>± 5 iTHft*^ 1 5 

■5„ •?:©£*, saf^/wi i <fctcjL;t-c^ 

i7*?i'HSBfc#fejK'f VtV v^7^ h§£«2 2© 

[0 0 6 4] r©fc», BftJljPfllLiPLfc^VhSi 
B^BSt*^^^^ ©t'fcK*** 5K9WEWlS*i 
•CV>5Eft*y 7 1 3as»#, &:fc;4>o#fi7K^ VtV 
Vj/7^ h£«2 2©3fo&s*©*fcfc3fc<5J:5K:* 
•So *©*:*> *»©fta*>«7^*)'5»^-et>5Htfc 
V^§tl2 0ttgail 9*J7*9Vh*B*ATV^5 

[0 0 6 5] !OJ:5C, ^©SS^^-tU^fi, 
[0 0 6 6] ^©^i^fiTj^^i^^VT 1 

-r^7-f hSSB©«* S; F-S:©»^t#*.e»n5. 

[0 0 6 7] ^©i^iii^iCtl, g&7Jy7£*fe# 
^7-f yVy4 y&WZm-tK^y hn-vH- 5o * 
LT=g-*©^«*> ^Id^-ta^fe^-Y VtV v^/7 
h^BSr*filo*feT^<„ ^«*^7 5r3l^Lfc 

[0 0 6 8] ^©ip^KHfi, 7"7yh»gffi 
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ffiUfc^-CfcS. 110 1 \*gm<D* :✓✓<-, 110 2 

[0 0 6 9] SWf #*ft#<OiSR5#^Vr 

©&M*1 1 0 2fc{fc*.TV*3. #&*1 1 0 2<0±U 
\C\tT 4 * 7° W !JSa«)3i*tfCV ^-CSSICIS* y fv< 

1 0 1 1 1 0 2±fc8fto-CV>5tB#fl!l<0# 
»©Wft«r»1-rtfcJ:oT. ft#1lll©&»£a>S4fe 
ft, AftftiflriftWyf-f^?^ hSlg2 2-em 

[0070] roiiiiltfv^rtKJioT, & 
fc#^©J«H©«*©11MRS:*ffU aK-^^-f^^i- 

[00 7 1] 

fc1-a*£©#W 
[iaii©ffl¥fclMin 

[0i] mitt, MWyf^v^7^ Mgettfc&m 



[122] 0 2I4> * y <n? J**7F\s1d®£M 

[B3] 12 31*, jisfi^^-f h£B*£tt 
*^7i H»£lclW#Pl-a **«©:/ n y y Elt?fcSo 
[El 4] H4». g&^fc?87fcgS£ottfcl|}fi0iJ© 

[El5] ElSte, fta^-fJ^u-fi©******© 

[ii 6] egea, wfc^fcjfl^5*JU£flMrtMi:*9 

[El 7] H7tt, ^©^i^fetf'f VtV^^ 

[El 8] H8tt. ^saTfcUM-fcBSrWlf-aSIlK 
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CLAIMS 



[Claim(s)] 

[Claim 1] An image pick-up means to be remote pointing equipment which directs the object which is in B point 
from A point, and to picturize the image of B point, An image transfer means to transmit the image information 
obtained by this image pick-up means to A point, An image display means to display on a screen the image 
transmitted from B point at A point, A directions means to direct the object of B point at A point based on the 
image displayed by this image display means. It is based on a control information generation means to generate 
control information according to the output of this directions means, a control information transfer means to 
transmit said control information to B point and the this transmitted control information. At B point Remote pointing 
equipment characterized by having a change inducement means to make change which can be checked by looking to 
said some of directed objects [ at least ] cause. 

[Claim 2] Said change inducement means is remote pointing equipment according to claim 2 characterized by being 
the beam arrangement which injects a light beam to an object 

[Claim 3] Said image pick-up means is remote pointing equipment according to claim 1 or 2 which is the television 
camera which can be operated by remote control, and is characterized by controlling the include angle of said 
television camera so that said object is located at the core of an image based on said control information. 
[Claim 4] Said image pick-up means is remote pointing equipment according to claim 2 which is the television 
camera which can be operated by remote control, and is characterized by fixing said beam arrangement to said 
television camera. 

[Claim 5] Said television camera is remote pointing equipment according to claim 2 characterized by for said image 
pick-up means being the television camera which can be operated by remote control, and controlling independently 
the include angle of said beam arrangement 

[Claim 6] Said directions means is remote pointing equipment according to claim 1 characterized by specifying an 
object based on the coordinate directed on said screen. 

[Claim 7] Remote pointing equipment according to claim 6 characterized by having further a recognition means to 
recognize the identifier of each tag based on the image of two or more tags which the identifier of an object was 
indicated and were attached in the object concerned, and two or more of said tags obtained by said image pick-up 
means, and specifying said object based on said directed coordinate and the recognition result of the identifier of 
each tag. 

[Claim 8] Said directions means is remote pointing equipment according to claim 1 characterized by specifying an 
object based on the name of the object which it keyed. 

[Claim 9] Said directions means is remote pointing equipment according to claim 1 characterized by specifying an 
object based on the list menu of an object on said screen. 

[Claim 10] Said directions means is remote pointing equipment according to claim 1 characterized by specifying an 
object based on two or more icons showing an object 

[Claim 1 1] Said control information generation means is remote pointing equipment according to claim 2 or 5 
characterized by acquiring the current include-angle information on said beam arrangement, and generating said 
control information also using this include-angle information. 

[Claim 12] Said control information generation means is remote pointing equipment according to claim 3 or 4 
characterized by acquiring the current include-angle information on said television camera, and generating said 
control information also using this include-angle information. 

[Claim 13] The process monitoring system characterized by having made said A point into the central operation 
room, and making said B point into the site of a plant using remote pointing equipment according to claim 1. 
[Claim 14] The remote conference system characterized by making 2 sets of remote indication possible from the 
both sides of teleconferencing using remote pointing equipment according to claim 1. 
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TECHNICAL FIELD 



[Industrial Application] When making an informational exchange and the decision of an intention like a plant monitor 
or teleconferencing in the distant location, this invention connects the demonstrative pronoun used all busy to 
things actual, and relates to the remote pointing equipment which can direct an object smoothly. 
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PRIOR ART 



[Description of the Prior Art] In the conference system which used from the former ISDN used for teleconferencing 
etc., sharing of the information by the meeting participant was done electronically. This aims at each other intention 
Bahnung by electronizing a document, a photograph, etc. sharing with a word processor, a scanner, etc. beforehand, 
storing into the terminal, and pointing to it from both sides with an electronic pointing device. 

[0003] However, the activity which incorporates information is required of such a gestalt in a terminal. Moreover, the 
body on the desk which cannot be beforehand incorporated as information was pointed out, and the directions "it 
was the same as the color" were not completed. 

[0004] Moreover, in order to share data which were obtained newly on that spot to each other, information was 
sharable by projecting the data using a paintings-and-calligraphic-works television camera. However, there is no 
means for near human being without data to point to some data, and now could not but explain it by means of 
language etc. 

[0005] Moreover, on the other hand, the hitcher on who is present in a central operation room with the television 
camera installed in the site of a plant can supervise a site now with an image as indicated by JP,3~1297,A etc. in 
the plant system. In such a plant monitor, it may have been said that it contacted by a transceiver etc. between the 
hitcher on who is present in a central operation room, and the customer engineer which is working in the site of a 
plant, and an activity was done. Bahnung of an intention was not able to be aimed at, if it did not decide about how 
to call a location or a direction as soon as it unified about the name of a device beforehand from hitchers on at this 
time, when the part and location of a device were specified. 

[0006] Furthermore, although there is a monitor for a monitor in a central operation room, since the scene which the 
hitcher on is looking at is not visible to the customer engineer of a site, the approach of intuitive assignment that a 
hitcher on points out a direct monitor and specifies a device cannot be used. 
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TECHNICAL PROBLEM 



[Problem(s) to be Solved by the Invention] Thus, in the former, in order to direct information between remote 
places, means, such as an image and voice, were used, and it was shown indirectly and was directing. However, by 
these approaches, since equipment special to both remote places was required, when it was not helpful in moment 
[ **** / that there is information to which it can never point / beforehand ] since preparation is required, and a 
partner moved about, there was a problem of being inapplicable etc. 

[0008] In this invention, in order to solve this problem, in the situation of exchanging image information which used 
television cameras, such as a plant monitor and teleconferencing, the remote pointing equipment which can tell the 
information where the side here is gazing with the television camera, more directly to the other party which is 
present in the distant place is offered. 



[Translation done.] 



* NOTICES * 



JPO and NC1PI are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



MEANS 



[Means for Solving the Problem] An image pick-up means for the remote pointing equipment by this invention to be 
remote pointing equipment which directs the object which is in B point from A point and to picturize the image of B 
point, An image transfer means to transmit the image information obtained by this image pick-up means to A point 
An image display means to display on a screen the image transmitted from B point at A point, A directions means to 
direct the object of B point at A point based on the image displayed by this image display means, It is based on a 
control information generation means to generate control information according to the output of this directions 
means, a control information transfer means to transmit said control information to B point, and the this transmitted 
control information. At B point It has a change inducement means to make change which can be checked by looking 
to said some of directed objects [ at least ] cause. 

[0010] Preferably, said change inducement means is a beam arrangement which injects a light beam to an object. 
[001 1] Said image pick-up means is the television camera which can be operated by remote control, and the include 
angle of said television camera is controlled so that said object is located at the core of an image based on said 
control information. 

[0012] Moreover, using this remote pointing equipment, said A point is made into a central operation room, and the 
process monitoring system by this invention makes said B point the site of a plant. 

[0013] Furthermore, the remote conference system by this invention makes 2 sets of remote indication possible 
from the both sides of teleconferencing using said remote pointing equipment. 
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OPERATION 



[Function] Hereafter, an operation of the typical configuration of this invention is explained. 

[0015] Two or more objects which it is going to direct exist in B point, and the image of B point is displayed by the 
image transfer means on the screen of a display means with image pick-up means, such as a television camera, at A 
point. When those who are present in A point are going to direct the object at B point, an object is directed on a 
screen with a directions means. Based on this directions information, the control information for controlling change 
inducement means, such as a beam arrangement, by the control information generation means is generated, and it is 
transmitted to B point by the control information transfer means. The include angle of a television camera is 
controlled to locate at the core of an image the object directed to coincidence. Only a television camera is 
controlled when the beam arrangement is being fixed to the television camera. 

[001 6] The spot of a light beam hits the object which those who are present in A point directed by this 
configuration, and those what whose those who are present in A point are directing it is in B point can recognize 
immediately and certainly. Prior preparation which electronizes an object to direct beforehand and is incorporated to 
the terminal is unnecessary, and also when a partner moves about, it can respond easily. 
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EFFECT OF THE INVENTION 



[Effect of the Invention] It comes to be able to perform the increase of the means of the communication in the 
distant location, and a better plant monitor by this invention. The time and effort of electronizing a document on the 
occasion of informational sharing until now stops moreover, taking by applying this invention to a remote conference 
system. 
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EXAMPLE 



[Example] First, the example which applied this invention to the plant monitor at drawin g 1 is shown, this drawing — 
setting — 11 — a monitor display and 12 — a touch panel and 13 — a surveillance camera and 14 — a surveillance 
camera remote control and 15 — the network for remote control, and 16 — for plant equipment and 19, as for a 
customer engineer and 21, a monitor and 20 are [the network for image transmission, and 17 / a workstation and 

18 / a transceiver and 22 ] red pointing light equipment 

[0018] The surveillance camera remote control 14 consists of a microcomputer (microcomputer), a stepping motor, 
and a position sensor. A microcomputer can be moved according to the command from a workstation 17 received 
through the network 15 for remote control at the include angle which had the surveillance camera 13 specified using 
a stepping motor. Moreover, the current rate of a zoom and current include angle of a surveillance camera 13 are 
investigated using a sensor, and it has the function to tell a workstation 17 about it through the network 15 for 
remote control. The network 15 for remote control is an I/O bus which ties the microcomputer and workstation in 
the surveillance camera remote control 14. The network 16 for image transmission is carrying the image from a 
surveillance camera 13 to the workstation 17 using multiplex transmission. 

[0019] Now, the monitor 19 who is supervising the plant in the central operation room considers the case where it is 
going to point to plant equipment 18 to the customer engineer 20 which is present in the site of a plant A monitor 

19 directs "to check this plant equipment" to a customer engineer 20 using a transceiver 21. To coincidence, a 
monitor 19 points to the location of plant equipment 18 on the monitor display 11. 

[0020] A touch panel 12 senses the location (x y) to which the monitor 19 pointed on the screen, and notifies it to a 
workstation 17. However, (x, y) are x when making the core of the direction of an optical axis, i.e., a screen, into a 
zero, and y rectangular coordinates. 

[0021] A workstation 17 asks the current rate 2 of a zoom of a surveillance camera 13 through the network 15 for 
remote control. And the include angle to which a surveillance camera 13 is moved from the location on the screen 
to which the monitor 19 told from the touch panel 12 pointed (x y) is calculated as follows. 

[0022] Drawin g 2 shows relation with the frame actually regarded as the screen of the monitor display 11. the time 
of the rate Z= 1 of a zoom — a gap angle with the optical axis of the point on a screen (x y) — the direction of a x 
axis, and the direction of the y-axis — receiving — ** (Rx, Ry) — if it carries out — Rx = atan (x/T) It is set to Ry 
= atan (y/T). Here, although T is the distance from the screen to the imagination vanishing point O, this serves as a 
constant of a camera proper. Gap with the optical axis when considering the rate of a zoom, since some which are 
visible to the location of (x, y) on a screen were in the location of (x/Z, y/Z) at the time of the rate Z= 1 of a zoom 
in practice when the rate of a zoom changed (several 1) Rx = atan (x/ZT) Ry = atan (y/ZT) 
It becomes. 

[0023] Based on this count of several one, the include angle of a surveillance camera 13 is changed by the include 
angle (Rx, Ry). That is, a command is sent to the surveillance camera remote control 14 through the network 15 for 
remote control so that only the degree of -Ry may be moved in the x directions in the degree of -Rx, and the 
direction of Y. The surveillance camera remote control 14 which received the command moves a surveillance 
camera 13. Thereby, a surveillance camera 13 takes an include angle for which the location to which the monitor 19 
pointed comes to the middle of a screen. 

[0024] On the other hand, red pointing light equipment 22 is attached in the surveillance camera 13, and the sense 
is set up so that it may be in agreement with the optical axis of the lens of a surveillance camera 13 exactly. 
Therefore, the light of red pointing light equipment 22 shines upon the plant equipment 18 which is showing at the 
core on the monitor display 11. 

[0025] for this reason, the plant equipment 18 to which the hitcher on pointed takes the lead in a monitor display — 
as — a surveillance camera 13 — moving — in addition — and the light of red pointing light equipment 22 comes to 
shine upon that body. Therefore, the customer engineer 20 which is present in a site can understand concretely that 
the hitcher on 19 is looking at plant equipment 18. 

[0026] In addition, red pointing equipment 22 may be unable to be exactly set by the optical axis by having fixed to 
the upper part of a direct camera. Then, the approach make it whose optical axis of a light correspond with the 
optical axis of a camera using a half mirror and prism is also considered. 

[0027] Drawin g 3 shows the example which controls a surveillance camera 13 directly rather than fixes red pointing 
light equipment to a surveillance camera 13. In this drawing, the same reference number is given to the same 
element as drawin g 1 . In this example, the pointing light remote control 23 which controls red pointing light 
equipment 22 and this is arranged independently [ a surveillance camera 13 ], and is connected to the network 15 
for remote control. 

[0028] This example also considers the case where the monitor 1 9 who is supervising the plant is going to point to 



[0029] A monitor 19 directs "to check this plant equipment" to a customer engineer 20 using a transceiver 21. To 
coincidence, it points to the location of plant equipment 18 on the monitor display 11. 

[0030] A touch panel 12 senses the location (x y) to which the monitor 19 pointed on the screen, and notifies a 
workstation 1 7 of it However, (x, y) are the coordinates when making the core of the direction of an optical axis, i.e., 
a screen, into a zero. 

[0031] A workstation 17 asks the current rate Z of a zoom of a surveillance camera 13 through the network 15 for 
remote control. And the include angle to which red pointing equipment 22 is moved from the location on the screen 
to which the monitor 19 told from the touch panel 12 pointed (x y) is calculated using one above. 
[0032] Next, a current include angle (Bx, By) is asked to the surveillance camera remote control 14. The red 
pointing light 22 is moved by the include angle (Rx-Bx, Ry-By) using this. That is, a command is sent to the pointing 
remote control 23 through the network 15 for remote control so that only the degree of -Ry+By may be moved in 
the direction of X in the degree of -Rx+Bx, and the direction of Y. The pointing light remote control 23 operates red 
pointing light equipment 22 according to this value. Consequently, a light hits plant equipment 18. Thereby, the plant 
equipment 18 to which the monitor 19 is pointing can understand a customer engineer 20 concretely. 
[0033] Furthermore, also when operating independently a surveillance camera 13 and red pointing light equipment 22 
(** which is not interlocked), it thinks. If this approach is used, a camera is moved, a light is put in red pointing 
equipment 22 to coincidence at that thing to which it was pointed out so that it may become centering on the 
object to which it was usually pointed out on the monitor display 11, when pointed out to the body which is not 
turned by limit of the surveillance camera remote control 14 by the hitcher on 19, only red pointing equipment 22 is 
operated and a light can hit 

[0034] As a body directions means, drawing 4 attaches not a light but two or more lamps in the body beforehand, 
and shows the example which was made to direct by making the light switch on alternatively [ one piece ] of them. 
401 is the indicator lamp attached to plant equipment 18. 

[0035] The workstation 17 has the table what kind of device is arranged in which range of the coordinate of a 
monitor screen. Drawing 5 is the example of this table. The field on the screen which an item number occupies [ the 
1st train of this table ], and a device occupies [ the 2nd train ], and the 3rd train have the identifier of a device, and 
the 4th train has a number of a device. Thus, the identifier and equipment item number of a device are managed by 
the table with the data of the rectangular field occupied on the screen. In addition, the data of a rectangular field 
consist of data of upper left top-most vertices and lower right top-most vertices. 

[0036] This table is searched in an order from the top, and it judges whether the coordinate (x y) from a touch panel 
12 is included to the field of the 2nd train. If not contained, it progresses to a degree. 

[0037] Even if it all searches a table, nothing is done when the field where a coordinate is included is not found. 
[0038] When a coordinate (x y) is included, the switch of the lamp 401 currently attached to the device from the 
number of the device of the 4th train is decided, and a command is outputted so that the switch may be turned on 
for it from a workstation 17. When the switch of the lamp 401 of another device is already on, the command which 
turns off the switch is also outputted. 

[0039] In order for a workstation 17 to perform entering/end of a switch, the approach of connecting a 
microcomputer is in the port for an output of workstations, such as RS232c. According to delivery and it the relay 
circuit corresponding easy commands, such as "No.1 ON" and "No.2 OFF", to the number is operated in the 
direction of a microcomputer from a workstation side, and closing motion of a switch can be realized. 
[0040] By performing such actuation, when red pointing light equipment 22 is used, it can point to the part of the 
fine device which was not able to be directed. 

[0041] Moreover, although the device to which it pointed was specified altogether until now, using the information on 
a touch panel as it is. when [ complicated ] the device is mutually complex, it is surely hard to attach distinction 
between devices. In this case, other examples which specify a device more correctly using image recognition are 
offered. The approach of fixing red pointing light equipment to a surveillance camera is adopted as body directions. 
The configuration of a device becomes the same as drawin g 1 . 

[0042] Like an old example, if a hitcher on 19 directs a touch panel 12 on the monitor display 11, the coordinate on 
the screen (x y) will be notified to a workstation 1 7. 

[0043] The tag 601 for image recognition as shown in drawing 6 is attached to the device. The number of a device is 
indicated by this tag 601. A workstation 17 starts only the part of this tag by the image processing from the 
information on the image of a camera. This is realizable by building the filter of starting the field where a certain 
regular magnitude is white. If two or more tags are in an image, two or more tags will be cut down. 
[0044] The thing near a coordinate (x y) in location is most taken out on a monitor scope among the images of the 
field of two or more cut-down tags. When two or more fields correspond, the thing near most the upper left is 
chosen on a screen. 

[0045] The number of the device currently written in the selected field is read according to recognition of a figure. 
[0046] The table which made the group the number of a device and the include angle of the red pointing light 
equipment 22 corresponding to it is stored in the workstation 1 7. The example of this table is shown in drawin g 7 . 
The 1 st train of this table shows the number of a device, the include angle of the x directions of red pointing light 
equipment and the 4th train are [ the name of a device, and the 3rd train ] the same, and the 2nd train shows the 
include angle of the direction of y. When in agreement [ as compared with the 1 st train and order of this table ] in 
the number of the recognized device, it is ordered the include angle by which a surveillance camera 13 should run 
through the network 15 for remote control to the pointing equipment remote control 14. The surveillance camera 
remote control 14 moves a surveillance camera 13 according to this value. Consequently, a surveillance camera 13 
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comes to the middle of a screen. 

[0047] The light of red pointing light equipment 22 will compare a tag with coincidence, and a customer engineer 20 
can understand immediately to which device the hitcher on 1 9 pointed. 

[0048] Furthermore, drawin g 8 is an example using not the approach using coordinate information but the mouse and 
menu on the screen according to a touch panel for a hitcher on 19 pointing to a device. For 801, as for a selection 
menu and 803, in this drawing, a mouse and 802 are [ a mouse pointer and 804 ] keyboards. The configuration of the 
whole device is the same as drawin g 1 . In addition, a menu may use an icon. 

[0049] A monitor operates a mouse pointer 803 by moving a mouse 801. On the monitor display 1 1 t the identifier of 
the device used as the candidate for a monitor is displayed in the form of a selection menu 802. The item of the 
device in a selection menu 802 to point to a pointer 803 is chosen, and the item of a push menu is chosen for the 
carbon button of a mouse 301. 

[0050] All over the workstation 17, the table which made the group the item number of a menu and the include angle 
of the red pointing light equipment 22 corresponding to it is stored. The example of this table is shown in drawin g 9 
R> 9. The 1st train of a table shows a menu item number, as for the 2nd train, a device name and the 3rd train are 
the same and the include angle of the x directions of red pointing light equipment and the 4th train show the include 
angle of the direction of y. 

[0051] When both are in agreement in the item number of the selected menu as compared with numerical order of 
the 1st train of this table, according to the contents of that menu item number, it is ordered the include angle by 
which a surveillance camera 13 should run through the network 15 for remote control to the pointing equipment 
remote control 14. According to this, the surveillance camera remote control 14 moves a surveillance camera 13. 
Consequently, a surveillance camera 13 becomes the include angle for which the image of the device to which a 
monitor 1 9 wants to point comes to the middle of a screen. 

[0052] The light of red pointing light equipment 22 will compare a device with coincidence, and, as for a customer 
engineer 20, a hitcher on 19 can understand immediately to which device it pointed. 

[0053] Similarly, not a coordinate but the command input on a screen can be used for the decision of the body to 
direct. 

[0054] In this case, a monitor inputs the name of a device to point from a keyboard 804. All over the workstation 1 7, 
the table which made the group the name of a device and the include angle of the red pointing light equipment 
corresponding to it is stored. The table shown in drawin g 7 can be used similarly. 

[0055] When in agreement [ as compared with the 2nd train and order of this table ] in the name of the inputted 
device, it is ordered the include angle by which a surveillance camera should run through the network for remote 
control to a pointing equipment remote control. A surveillance camera remote control moves a surveillance camera 
like this value, and a surveillance camera becomes the include angle for which the image of the device to which a 
monitor wants to point comes to the middle of a screen. The light of red pointing light equipment 22 will compare a 
device with coincidence, and a customer engineer 20 can understand to which device it pointed. 
[0056] The same actuation is possible even if there are two or more still such surveillance cameras 13 and red 
pointing light equipments 22. A system configuration is shown in drawin g 10 . The case where red pointing light 
equipment 22 is being fixed to the surveillance camera 13 is explained. 

[0057] The hitcher on 19 is doing the joint activity on the customer engineer 20. When it arrives at the location 
which works, a customer engineer 20 uses a transceiver and tells a hitcher on 19 about a current location. 
[0058] The hitcher on 19 who received the communication orders a workstation 17 so that the image of the 
surveillance camera 13 in the location may be projected on a screen. 

[0059] A workstation 17 changes to the surveillance camera 13 of the location in which a customer engineer 20 is, 
and displays on the monitor display 1 1. It is ordered the independent connection with the surveillance camera 
remote control 14 attached to the surveillance camera 13 changed to coincidence to the network 15 for remote 
control now. A workstation 17 will not exchange information with one of the surveillance camera remote controls 14 
which have more than one after this. 

[0060] A monitor directs "to check this plant equipment" to a customer engineer 20 using a transceiver. To 
coincidence, it points to the location of plant equipment on the monitor display 1 1. 

[0061] A touch panel senses the location (x y) to which the monitor 19 pointed on the screen, and notifies it to a 
workstation 17. 

[0062] A workstation 17 asks the current rate Z of a zoom of the surveillance camera 13 by which current selection 
is made through the network 15 for remote control. And the include angle to which the surveillance camera 13 by 
which current selection is made from the location on the screen to which the monitor 1 9 told from the touch panel 
pointed (x y) is moved is calculated. (Several 1) Based on this count of several one, the include angle of the 
surveillance camera 13 by which current selection is made by the include angle (Rx, Ry) is changed. A command is 
sent to the surveillance camera remote control 14 by which current selection is made through the network 15 for 
remote control so that only the degree of -Ry may be moved in the x directions in the degree of -Rx, and the 
direction of Y. The surveillance camera remote control 14 by which current selection is made moves the 
surveillance camera 13 by which current selection is made like this value, and the surveillance camera 13 by which 
current selection is made becomes the include angle for which the location which the monitor 19 pointed out comes 
to the middle of a screen. 

[0063] Red pointing light equipment 22 is attached in the surveillance camera 15, and the sense is set up so that it 
may be in agreement with the optical axis of the lens of a surveillance camera 15 exactly. Therefore, the light of red 
pointing light equipment 22 comes to shine upon the plant equipment which is showing at the core on the monitor 
display 1 1 . 
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which the hitcher on pointed may take the lead in a monitor display — moving — in addition — and the light of red 
pointing light equipment 22 comes to shine upon that body. Therefore, even when there are two or more surveillance 
cameras, the customer engineer 20 which is present in a site can understand concretely that the hitcher on 19 is 
looking at plant equipment 

[0065] Thus, even when there are two or more surveillance cameras and red pointing light equipment, a hitcher on 
can point to a device to a customer engineer like one case. 

[0066] Moreover, at this time, also when the number of a surveillance camera and red pointing light equipment is an 
inequality, it thinks. 

[0067] In such a case, a surveillance camera and red pointing light equipment are controlled separately. And at least 
one red pointing light equipment corresponding to each surveillance camera is decided. If there is red pointing light 
equipment when a surveillance camera is chosen, it will suppose that a suitable thing is chosen, and if there is 
nothing, a hitcher on will be notified of pointing being impossible. 

[0068] Moreover, such equipment can be used not only for the monitor of a plant but for a system which holds a 
conference by remoteness. Drawin g 1 1 is the example which carried out this invention in teleconferencing. It is a 
meeting table having the workstation by which 1 101 embedded the member of a meeting and 11 02 embedded the 
display and the touch panel. 

[0069] The meeting table 1 102 with a built-in workstation which controls a partner's remote pointing equipment 
respectively is offered on both conference rooms. The display is embedded in the upper part of the meeting table 
1 102, and the touch panel is attached to the front face. By pointing out the image in the hall of the other party 
reflected on this meeting table 1 102, the member 1 101 who has participated in the meeting can point to a body, a 
person, etc. at the hall of the other party with red pointing light equipment 22. 

[0070] By using such equipment the pointing of the information on the environment around each other can be 
shared and carried out, and closer communication is attained. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] When making an informational exchange and the decision of an intention like a plant monitor 
or teleconferencing in the distant location, this invention connects the demonstrative pronoun used all busy to 
things actual, and relates to the remote pointing equipment which can direct an object smoothly. 
[0002] 

[Description of the Prior Art] In the conference system which used from the former ISDN used for teleconferencing 
etc., sharing of the information by the meeting participant was done electronically. This aims at each other intention 
Bahnung by electronizing a document, a photograph, etc. sharing with a word processor, a scanner, etc. beforehand, 
storing into the terminal, and pointing to it from both sides with an electronic pointing device. 

[0003] However, the activity which incorporates information is required of such a gestalt in a terminal. Moreover, the 
body on the desk which cannot be beforehand incorporated as information was pointed out and the directions "it 
was the same as the color" were not completed. 

[0004] Moreover, in order to share data which were obtained newly on that spot to each other, information was 
sharable by projecting the data using a paintings-and-calligraphic-works television camera. However, there is no 
means for near human being without data to point to some data, and now could not but explain it by means of 
language etc. 

[0005] Moreover, on the other hand, the hitcher on who is present in a central operation room with the television 
camera installed in the site of a plant can supervise a site now with an image as indicated by JP,3-1297,A etc. in 
the plant system. In such a plant monitor, it may have been said that it contacted by a transceiver etc. between the 
hitcher on who is present in a central operation room, and the customer engineer which is working in the site of a 
plant and an activity was done. Bahnung of an intention was not able to be aimed at if it did not decide about how 
to call a location or a direction as soon as it unified about the name of a device beforehand from hitchers on at this 
time, when the part and location of a device were specified. 

[0006] Furthermore, although there is a monitor for a monitor in a central operation room, since the scene which the 
hitcher on is looking at is not visible to the customer engineer of a site, the approach of intuitive assignment that a 
hitcher on points out a direct monitor and specifies a device cannot be used. 
[0007] 

[Problem(s) to be Solved by the Invention] Thus, in the former, in order to direct information between remote 
places, means, such as an image and voice, were used, and it was shown indirectly and was directing. However, by 
these approaches, since equipment special to both remote places was required, when it was not helpful in moment 
[ **** / that there is information to which it can never point / beforehand ] since preparation is required, and a 
partner moved about there was a problem of being inapplicable etc. 

[0008] In this invention, in order to solve this problem, in the situation of exchanging image information which used 
television cameras, such as a plant monitor and teleconferencing, the remote pointing equipment which can tell the 
information where the side here is gazing with the television camera, more directly to the other party which is 
present in the distant place is offered. 
[0009] 

[Means for Solving the Problem] An image pick-up means for the remote pointing equipment by this invention to be 
remote pointing equipment which directs the object which is in B point from A point and to picturize the image of B 
point An image transfer means to transmit the image information obtained by this image pick-up means to A point 
An image display means to display on a screen the image transmitted from B point at A point A directions means to 
direct the object of B point at A point based on the image displayed by this image display means, It is based on a 
control information generation means to generate control information according to the output of this directions 
means, a control information transfer means to transmit said control information to B point and the this transmitted 
control information. At B point It has a change inducement means to make change which can be checked by looking 
to said some of directed objects [ at least ] cause. 

[0010] Preferably, said change inducement means is a beam arrangement which injects a light beam to an object 
[0011] Said image pick-up means is the television camera which can be operated by remote control, and the include 
angle of said television camera is controlled so that said object is located at the core of an image based on said 
control information. 

[0012] Moreover, using this remote pointing equipment said A point is made into a central operation room, and the 
process monitoring system by this invention makes said B point the site of a plant 

[0013] Furthermore, the remote conference system by this invention makes 2 sets of remote indication possible 



[0014] 

[Function] Hereafter, an operation of the typical configuration of this invention is explained. 

[0015] Two or more objects which it is going to direct exist in B point and the image of B point is displayed by the 
image transfer means on the screen of a display means with image pick-up means, such as a television camera, at A 
point When those who are present in A point are going to direct the object at B point an object is directed on a 
screen with a directions means. Based on this directions information, the control information for controlling change 
inducement means, such as a beam arrangement by the control information generation means is generated, and it is 
transmitted to B point by the control information transfer means. The include angle of a television camera is 
controlled to locate at the core of an image the object directed to coincidence. Only a television camera is 
controlled when the beam arrangement is being fixed to the television camera. 

[0016] The spot of a light beam hits the object which those who are present in A point directed by this 
configuration, and those what whose those who are present in A point are directing it is in B point can recognize 
immediately and certainly. Prior preparation which electronizes an object to direct beforehand and is incorporated to 
the terminal is unnecessary, and also when a partner moves about it can respond easily. 
[0017] 

[Example] First, the example which applied this invention to the plant monitor at drawin g 1 is shown, this drawing — 
setting — 11 — a monitor display and 12 — a touch panel and 13 — a surveillance camera and 14 — a surveillance 
camera remote control and 15 — the network for remote control, and 16 — for plant equipment and 19, as for a 
customer engineer and 21 , a monitor and 20 are [ the network for image transmission, and 17 / a workstation and 

18 / a transceiver and 22 ] red pointing light equipment 

[0018] The surveillance camera remote control 14 consists of a microcomputer (microcomputer), a stepping motor, 
and a position sensor. A microcomputer can be moved according to the command from a workstation 1 7 received 
through the network 15 for remote control at the include angle which had the surveillance camera 13 specified using 
a stepping motor. Moreover, the current rate of a zoom and current include angle of a surveillance camera 13 are 
investigated using a sensor, and it has the function to tell a workstation 17 about it through the network 15 for 
remote control. The network 15 for remote control is an I/O bus which ties the microcomputer and workstation in 
the surveillance camera remote control 14. The network 16 for image transmission is carrying the image from a 
surveillance camera 13 to the workstation 17 using multiplex transmission. 

[0019] Now, the monitor 19 who is supervising the plant in the central operation room considers the case where it is 
going to point to plant equipment 18 to the customer engineer 20 which is present in the site of a plant A monitor 

19 directs "to check this plant equipment" to a customer engineer 20 using a transceiver 21. To coincidence, a 
monitor 19 points to the location of plant equipment 18 on the monitor display 11. 

[0020] A touch panel 12 senses the location (x y) to which the monitor 19 pointed on the screen, and notifies it to a 
workstation 17. However, (x, y) are x when making the core of the direction of an optical axis, i.e., a screen, into a 
zero, and y rectangular coordinates. 

[0021] A workstation 17 asks the current rate Z of a zoom of a surveillance camera 13 through the network 15 for 
remote control. And the include angle to which a surveillance camera 13 is moved from the location on the screen 
to which the monitor 19 told from the touch panel 12 pointed (x y) is calculated as follows. 

[0022] Drawin g 2 shows relation with the frame actually regarded as the screen of the monitor display 11. the time 
of the rate Z= 1 of a zoom — a gap angle with the optical axis of the point on a screen (x y) — the direction of a x 
axis, and the direction of the y-axis — receiving — ** (Rx, Ry) — if it carries out — Rx = atan (x/T) It is set to Ry 
= atan (y/T). Here, although T is the distance from the screen to the imagination vanishing point O, this serves as a 
constant of a camera proper. Gap with the optical axis when considering the rate of a zoom, since some which are 
visible to the location of (x, y) on a screen were in the location of (x/Z t y/Z) at the time of the rate Z= 1 of a zoom 
in practice when the rate of a zoom changed (several 1) Rx = atan (x/ZT) Ry = atan (y/ZT) 
It becomes. 

[0023] Based on this count of several one, the include angle of a surveillance camera 13 is changed by the include 
angle (Rx, Ry). That is, a command is sent to the surveillance camera remote control 14 through the network 15 for 
remote control so that only the degree of -Ry may be moved in the x directions in the degree of -Rx, and the 
direction of Y. The surveillance camera remote control 14 which received the command moves a surveillance 
camera 13. Thereby, a surveillance camera 13 takes an include angle for which the location to which the monitor 19 
pointed comes to the middle of a screen. 

[0024] On the other hand, red pointing light equipment 22 is attached in the surveillance camera 13, and the sense 
is set up so that it may be in agreement with the optical axis of the lens of a surveillance camera 13 exactly. 
Therefore, the light of red pointing light equipment 22 shines upon the plant equipment 18 which is showing at the 
core on the monitor display 11. 

[0025] for this reason, the plant equipment 18 to which the hitcher on pointed takes the lead in a monitor display — 
as — a surveillance camera 13 — moving — in addition — and the light of red pointing light equipment 22 comes to 
shine upon that body. Therefore, the customer engineer 20 which is present in a site can understand concretely that 
the hitcher on 1 9 is looking at plant equipment 1 8. 

[0026] In addition, red pointing equipment 22 may be unable to be exactly set by the optical axis by having fixed to 
the upper part of a direct camera. Then, the approach make it whose optical axis of a light correspond with the 
optical axis of a camera using a half mirror and prism is also considered. 

[0027] Drawin g 3 shows the example which controls a surveillance camera 13 directly rather than fixes red pointing 
light equipment to a surveillance camera 1 3. In this drawing, the same reference number is given to the same 
element as drawin g 1 . In this example, the pointing light remote control 23 which controls red pointing light 



for remote control. 

[0028] This example also considers the case where the monitor 1 9 who is supervising the plant is going to point to 
plant equipment 18 in the central operation room to the customer engineer 20 which is present in the site of a plant 

[0029] A monitor 19 directs "to check this plant equipment" to a customer engineer 20 using a transceiver 21. To 
coincidence, it points to the location of plant equipment 18 on the monitor display 11. 

[0030] A touch panel 12 senses the location (x y) to which the monitor 19 pointed on the screen, and notifies a 
workstation 1 7 of it However, (x, y) are the coordinates when making the core of the direction of an optical axis, i.e., 
a screen, into a zero. 

[0031] A workstation 17 asks the current rate Z of a zoom of a surveillance camera 13 through the network 15 for 
remote control. And the include angle to which red pointing equipment 22 is moved from the location on the screen 
to which the monitor 19 told from the touch panel 12 pointed (x y) is calculated using one above. 
[0032] Next a current include angle (Bx, By) is asked to the surveillance camera remote control 14. The red 
pointing light 22 is moved by the include angle (Rx-Bx, Ry-By) using this. That is, a command is sent to the pointing 
remote control 23 through the network 15 for remote control so that only the degree of -Ry+By may be moved in 
the direction of X in the degree of -Rx+Bx, and the direction of Y. The pointing light remote control 23 operates red 
pointing light equipment 22 according to this value. Consequently, a light hits plant equipment 1 8. Thereby, the plant 
equipment 18 to which the monitor 19 is pointing can understand a customer engineer 20 concretely. 
[0033] Furthermore, also when operating independently a surveillance camera 13 and red pointing light equipment 22 
(** which is not interlocked), it thinks. If this approach is used, a camera is moved, a light is put in red pointing 
equipment 22 to coincidence at that thing to which it was pointed out so that it may become centering on the 
object to which it was usually pointed out on the monitor display 11, when pointed out to the body which is not 
turned by limit of the surveillance camera remote control 14 by the hitcher on 19, only red pointing equipment 22 is 
operated and a light can hit 

[0034] As a body directions means, drawin g 4 attaches not a light but two or more lamps in the body beforehand, 
and shows the example which was made to direct by making the light switch on alternatively [ one piece ] of them. 
401 is the indicator lamp attached to plant equipment 18. 

[0035] The workstation 17 has the table what kind of device is arranged in which range of the coordinate of a 
monitor screen. Drawing 5 is the example of this table. The field on the screen which an item number occupies [ the 
1st train of this table ], and a device occupies [ the 2nd train ], and the 3rd train have the identifier of a device, and 
the 4th train has a number of a device. Thus, the identifier and equipment item number of a device are managed by 
the table with the data of the rectangular field occupied on the screen. In addition, the data of a rectangular field 
consist of data of upper left top-most vertices and lower right top-most vertices. 

[0036] This table is searched in an order from the top, and it judges whether the coordinate (x y) from a touch panel 
1 2 is included to the field of the 2nd train. If not contained, it progresses to a degree. 

[0037] Even if it all searches a table, nothing is done when the field where a coordinate is included is not found. 
[0038] When a coordinate (x y) is included, the switch of the lamp 401 currently attached to the device from the 
number of the device of the 4th train is decided, and a command is outputted so that the switch may be turned on 
for it from a workstation 1 7. When the switch of the lamp 401 of another device is already on, the command which 
turns off the switch is also outputted. 

[0039] In order for a workstation 1 7 to perform entering/end of a switch, the approach of connecting a 
microcomputer is in the port for an output of workstations, such as RS232c. According to delivery and it, the relay 
circuit corresponding easy commands, such as "No.1 ON" and "No.2 OFF", to the number is operated in the 
direction of a microcomputer from a workstation side, and closing motion of a switch can be realized. 
[0040] By performing such actuation, when red pointing light equipment 22 is used, it can point to the part of the 
fine device which was not able to be directed. 

[0041] Moreover, although the device to which it pointed was specified altogether until now, using the information on 
a touch panel as it is, when [ complicated ] the device is mutually complex, it is surely hard to attach distinction 
between devices. In this case, other examples which specify a device more correctly using image recognition are 
offered The approach of fixing red pointing light equipment to a surveillance camera is adopted as body directions. 
The configuration of a device becomes the same as drawing 1 . 

[0042] Like an old example, if a hitcher on 19 directs a touch panel 12 on the monitor display 11, the coordinate on 
the screen (x y) will be notified to a workstation 1 7. 

[0043] The tag 601 for image recognition as shown in drawin g 6 is attached to the device. The number of a device is 
indicated by this tag 601. A workstation 17 starts only the part of this tag by the image processing from the 
information on the image of a camera. This is realizable by building the filter of starting the field where a certain 
regular magnitude is white. If two or more tags are in an image, two or more tags will be cut down. 
[0044] The thing near a coordinate (x y) in location is most taken out on a monitor scope among the images of the 
field of two or more cut-down tags. When two or more fields correspond, the thing near most the upper left is 
chosen on a screen. 

[0045] The number of the device currently written in the selected field is read according to recognition of a figure. 
[0046] The table which made the group the number of a device and the include angle of the red pointing light 
equipment 22 corresponding to it is stored in the workstation 1 7. The example of this table is shown in drawin g 7 . 
The 1st train of this table shows the number of a device, the include angle of the x directions of red pointing light 
equipment and the 4th train are [ the name of a device, and the 3rd train ] the same, and the 2nd train shows the 
include angle of the direction of y. When in agreement [ as compared with the 1 st train and order of this table ] in 
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through the network 15 for remote control to the pointing equipment remote control 14. The surveillance camera 
remote control 14 moves a surveillance camera 13 according to this value. Consequently, a surveillance camera 13 
becomes the include angle for which the image of the tag nearest to the location which the monitor 19 pointed out 
comes to the middle of a screen. 

[0047] The light of red pointing light equipment 22 will compare a tag with coincidence, and a customer engineer 20 
can understand immediately to which device the hitcher on 19 pointed. 

[0048] Furthermore, drawin g 8 is an example using not the approach using coordinate information but the mouse and 
menu on the screen according to a touch panel for a hitcher on 19 pointing to a device. For 801, as for a selection 
menu and 803, in this drawing, a mouse and 802 are [ a mouse pointer and 804 ] keyboards. The configuration of the 
whole device is the same as drawin g 1 . In addition, a menu may use an icon. 

[0049] A monitor operates a mouse pointer 803 by moving a mouse 801. On the monitor display 1 1, the identifier of 
the device used as the candidate for a monitor is displayed in the form of a selection menu 802. The item of the 
device in a selection menu 802 to point to a pointer 803 is chosen, and the item of a push menu is chosen for the 
carbon button of a mouse 301. 

[0050] All over the workstation 17, the table which made the group the item number of a menu and the include angle 
of the red pointing light equipment 22 corresponding to it is stored. The example of this table is shown in drawin g 9 
R> 9. The 1st train of a table shows a menu item number, as for the 2nd train, a device name and the 3rd train are 
the same and the include angle of the x directions of red pointing light equipment and the 4th train show the include 
angle of the direction of y. 

[0051] When both are in agreement in the item number of the selected menu as compared with numerical order of 
the 1st train of this table, according to the contents of that menu item number, it is ordered the include angle by 
which a surveillance camera 13 should run through the network 15 for remote control to the pointing equipment 
remote control 14. According to this, the surveillance camera remote control 14 moves a surveillance camera 13. 
Consequently, a surveillance camera 13 becomes the include angle for which the image of the device to which a 
monitor 19 wants to point comes to the middle of a screen. 

[0052] The light of red pointing light equipment 22 will compare a device with coincidence, and, as for a customer 
engineer 20, a hitcher on 19 can understand immediately to which device it pointed. 

[0053] Similarly, not a coordinate but the command input on a screen can be used for the decision of the body to 
direct 

[0054] In this case, a monitor inputs the name of a device to point from a keyboard 804. All over the workstation 17, 
the table which made the group the name of a device and the include angle of the red pointing light equipment 
corresponding to it is stored. The table shown in drawin g 7 can be used similarly. 

[0055] When in agreement [ as compared with the 2nd train and order of this table ] in the name of the inputted 
device, it is ordered the include angle by which a surveillance camera should run through the network for remote 
control to a pointing equipment remote control. A surveillance camera remote control moves a surveillance camera 
like this value, and a surveillance camera becomes the include angle for which the image of the device to which a 
monitor wants to point comes to the middle of a screen. The light of red pointing light equipment 22 will compare a 
device with coincidence, and a customer engineer 20 can understand to which device it pointed. 
[0056] The same actuation is possible even if there are two or more still such surveillance cameras 13 and red 
pointing light equipments 22. A system configuration is shown in drawin g 10 . The case where red pointing light 
equipment 22 is being fixed to the surveillance camera 13 is explained. 

[0057] The hitcher on 19 is doing the joint activity on the customer engineer 20. When it arrives at the location 
which works, a customer engineer 20 uses a transceiver and tells a hitcher on 19 about a current location. 
[0058] The hitcher on 19 who received the communication orders a workstation 17 so that the image of the 
surveillance camera 13 in the location may be projected on a screen. 

[0059] A workstation 17 changes to the surveillance camera 13 of the location in which a customer engineer 20 is, 
and displays on the monitor display 1 1. It is ordered the independent connection with the surveillance camera 
remote control 14 attached to the surveillance camera 13 changed to coincidence to the network 15 for remote 
control now. A workstation 17 will not exchange information with one of the surveillance camera remote controls 14 
which have more than one after this. 

[0060] A monitor directs "to check this plant equipment" to a customer engineer 20 using a transceiver. To 
coincidence, it points to the location of plant equipment on the monitor display 11. 

[0061] A touch panel senses the location (x y) to which the monitor 19 pointed on the screen, and notifies it to a 
workstation 17. 

[0062] A workstation 17 asks the current rate Z of a zoom of the surveillance camera 13 by which current selection 
is made through the network 15 for remote control. And the include angle to which the surveillance camera 13 by 
which current selection is made from the location on the screen to which the monitor 19 told from the touch panel 
pointed (x y) is moved is calculated. (Several 1) Based on this count of several one. the include angle of the 
surveillance camera 13 by which current selection is made by the include angle (Rx, Ry) is changed. A command is 
sent to the surveillance camera remote control 14 by which current selection is made through the network 15 for 
remote control so that only the degree of -Ry may be moved in the x directions in the degree of -Rx, and the 
direction of Y. The surveillance camera remote control 14 by which current selection is made moves the 
surveillance camera 13 by which current selection is made like this value, and the surveillance camera 13 by which 
current selection is made becomes the include angle for which the location which the monitor 1 9 pointed out comes 
to the middle of a screen. 

[0063] Red pointing light equipment 22 is attached in the surveillance camera 15, and the sense is set up so that it 



pointing light equipment 22 comes to shine upon the plant equipment which is showing at the core on the monitor 
display 11. 

[0064] for this reason, the surveillance camera 1 3 by which current selection is made so that the plant equipment to 
which the hitcher on pointed may take the lead in a monitor display — moving — in addition — and the light of red 
pointing light equipment 22 comes to shine upon that body. Therefore, even when there are two or more surveillance 
cameras, the customer engineer 20 which is present in a site can understand concretely that the hitcher on 19 is 
looking at plant equipment 

[0065] Thus, even when there are two or more surveillance cameras and red pointing light equipment, a hitcher on 
can point to a device to a customer engineer like one case. 

[0066] Moreover, at this time, also when the number of a surveillance camera and red pointing light equipment is an 
inequality, it thinks. 

[0067] In such a case, a surveillance camera and red pointing light equipment are controlled separately. And at least 
one red pointing light equipment corresponding to each surveillance camera is decided. If there is red pointing light 
equipment when a surveillance camera is chosen, it will suppose that a suitable thing is chosen, and if there is 
nothing, a hitcher on will be notified of pointing being impossible. 

[0068] Moreover, such equipment can be used not only for the monitor of a plant but for a system which holds a 
conference by remoteness. Drawing 1 1 is the example which carried out this invention in teleconferencing. It is a 
meeting table having the workstation by which 1 101 embedded the member of a meeting and 1 102 embedded the 
display and the touch panel. 

[0069] The meeting table 1102 with a built-in workstation which controls a partners remote pointing equipment 
respectively is offered on both conference rooms. The display is embedded in the upper part of the meeting table 
1 102, and the touch panel is attached to the front face. By pointing out the image in the hall of the other party 
reflected on this meeting table 1 102, the member 1 101 who has participated in the meeting can point to a body, a 
person, etc. at the hall of the other party with red pointing light equipment 22. 

[0070] By using such equipment, the pointing of the information on the environment around each other can be 

shared and carried out, and closer communication is attained. 

[0071] 

[Effect of the Invention] It comes to be able to perform the increase of the means of the communication in the 
distant location, and a better plant monitor by this invention. The time and effort of electronizing a document on the 
occasion of informational sharing until now stops moreover, taking by applying this invention to a remote conference 
system. 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawin g 1] Drawing 1 is the block diagram of the example which fixed red pointing light equipment to the 
surveillance camera. 

[Drawin g 2] Drawin g 2 is the conceptual diagram having shown the frame of a surveillance camera. 

[Drawin g 3] Drawin g 3 is the block diagram of the example which controls red pointing light equipment independently 

of a surveillance camera. 

[Drawin g 4] Drawin g 4 is the explanatory view of the example which attached luminescence equipment to the 
candidate for a monitor. 

[ Drawin g 5] Drawing 5 is the explanatory view of an example of the correspondence table of the relation between 
the field on a monitor display, and a device. 

[Drawing 6] Drawing 6 is the explanatory view of an example of the tag attached in ** which uses an image 
processing for a monitor. 

[Drawin g 7] Drawin g 7 is the explanatory view of an example of the correspondence table of the name of a device, 
and the include angle of red pointing light equipment 

[ Drawin g 8] Drawing 8 is the explanatory view of the example which chooses the device to which it points with a 
menu. 

[Drawin g 9] Drawin g 9 is the explanatory view of an example of the correspondence table of a menu number and the 
include angle of red pointing light equipment 

[Drawin g 1 0 ] Drawin g 10 is the explanatory view of the example which used much surveillance cameras and red 
pointing light equipments. 

[Drawin g 1 1] Drawing 1 1 is the explanatory view of the example which applied this invention to the remote 
conference system. 
[Description of Notations] 

1 1 [ — A surveillance camera remote control, 15 / — The network for remote control, 16/ — The network for 
image transmission, 17 / — A workstation, 18 / — Plant equipment, 19 / — A monitor, 20 / — A customer 
engineer, 21 / — A transceiver, 22 / — Red pointing light equipment ] — A monitor display, 12 — A touch panel, 
13 — A surveillance camera, 14 
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[Section partition] The 3rd partition of the 6th section 
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[Annual volume number] Open patent official report 5-2046 

[Application number] Japanese Patent Application No. 4-10779 
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G06F 3/03 380 
3/033 360 
H04N 7/15 

[FI] 

606F 3/03 380 M 

3/033 360 C 

H04N 7/15 

[Procedure revision] 

[Filing Date] October 6, Heisei 10 

[Procedure amendment 1] 

[Document to be Amended] Specification 

[Item(s) to be Amended] Claim 

[Method of Amendment] Modification 

[Proposed Amendment] 

[Claim(s)] 

[Claim 1] It is remote pointing equipment which directs the object which is in B point from A point. 
An image pick-up means to picturize the image of B point, 

An image transfer means to transmit the image information obtained by this image pick-up means to A point, 

An image display means to display on a screen the image transmitted from B point at A point 

A directions means to direct the object of B point at A point based on the image displayed by this image display 

means, 

A control information generation means to generate control information according to the output of this directions 
means, 

A control information transfer means to transmit said control information to B point 

A change inducement means to make change which can be checked by looking to said some of directed objects [ at 
least ] cause at B point based on the transmitted this control information, 
Remote pointing equipment characterized by preparation ******. 

[Claim 2] Said directions means is remote pointing equipment according to claim 1 characterized by specifying an 
object based on the name of the object which it keyed. 

[Claim 3] Said directions means is remote pointing equipment according to claim 1 characterized by specifying an 
object based on the list menu of an object on said screen. 

[Claim 4] Said directions means is remote pointing equipment according to claim 1 characterized by specifying an 
object based on two or more icons showing an object 

[Claim 5] The process monitoring system characterized by having made said A point into the central operation room, 
and making said B point into the site of a plant using remote pointing equipment according to claim 1. 
[Claim 6] The remote conference system characterized by making 2 sets of remote indication possible from the 
both sides of teleconferencing using remote pointing equipment according to claim 1. 
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